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Phase space can be constructed for TV equal and distinguishable subsystems that could be (prob- 
abilistically) either weakly (or "locally") correlated (e.g., independent, i.e., uncorrelated), or strongly 
(or globally) correlated. If they are locally correlated, we expect the Boltzmann-Gibbs entropy 
Sbg = — k^2 i pi\npi to be extensive, i.e., Sbg(N) oc TV for TV — + oo. In particular, if they are 
independent, Sbg is strictly additive, i.e., Sbg(N) = TVSbg(I), VTV. However, if the subsystems 
are globally correlated, we expect, for a vast class of systems, the entropy Sq = k [1 — Y^iPi}/{Q~ 1) 
(with Si = Sbg) for some special value of q ^ 1 to be the one which extensive (i.e., S q (N) oc TV 
for TV — ► oo). Another concept which is relevant is strict or asymptotic scale-freedom (or scale- 
mvariance), defined as the situation for which all marginal probabilities of the TV-system coincide 
, or asymptotically approach (for TV — > oo) the joint probabilities of the (TV — l)-system. If each 

■ subsystem is a binary one, scale-freedom is guaranteed by what we hereafter refer to as the Leibnitz 

rule, i.e., the sum of two successive joint probabilities of the TV-system coincides or asymptotically 
approaches the corresponding joint probability of the (TV — l)-system. The kinds of interplay of these 
various concepts are illustrated in several examples. One of them justifies the title of this paper. 
We conjecture that these mechanisms are deeply related to the very frequent emergence, in natural 
and artificial complex systems, of scale-free structures and to their connections with nonextensive 
statistical mechanics. 
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The entropy S q 0, 0, i s defined through 



y\V q W 



S q = k ^ {q^K; S^SBG^-kY.Pt^), (1) 

where A: is a positive constant (k = 1 from now on) and BG stands for Boltzmann-Gibbs. This expression is the 
basis of nonextensive statistical mechanics 0, a current generalization of BG statistical mechanics. For q ^ 1, S q 
is nonadditive - hence nonextensive - in the sense that for a system composed of (probabilistically) independent 
subsystems, the total entropy differs from the sum of the entropies of the subsystems. However, the system may have 
special probability correlations between the subsystems such that extensivity is valid, not for Sbg, but for S q with 
a particular value of the index q ^ 1. In this paper, we address the case where the subsystems are all equal and 
distinguishable. Their correlations may exhibit a kind of scale-invariance. We may regard some of the situations of 
i-^j . correlated probabilities as related to the remark (see and references therein) that S q for q ^ 1 can be appropriate 
for nonlinear dynamical systems that have phase space unevenly occupied. We return to this point later. 

We shall consider two types of models. The first one involves TV binary variables (TV = 1, 2, 3, ...), and the second one 
involves TV continuous variables (TV = 1, 2, 3). In both cases, certain correlations that are scale-invariant in a suitable 
limit can create an intrinsically inhomogeneous occupation of phase space. Such systems are strongly reminiscent of 
the so called scale-free networks with their hierarchically structured hubs and spokes and their nearly forbidden 



5_j • regions. 
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II - DISCRETE MODELS 
Some basic concepts 

The most general probabilistic sets for N equal and distinguishable binary subsystems are given in Table I with 
A A" 

Vtt; w- f 7r JVjn = l (ttjv,,, G [0,1]; N= 1,2,3,...; n = 0,1, ..,7V) (2) 

' (iV — n ! n! 



(AT = 0) 1 

(AT = 1) 7T10 7T11 

(AT = 2) 7T20 7T21 7T22 

(N = 3) 7T30 7T31 7T32 7T33 

(N = 4) 7T40 7T41 7T42 7T43 7T44 



TABLE I: Most general sets of joint probabilities for N equal and distinguishable binary subsystems. 
Let us from now on call Leibnitz rule the following recursive relation: 

TTjv.n + TTiv.n+i = ^N-i,n {n = 0, 1, .., N - 1; N = 2, 3, ...).. (3) 

This relation guarantees what we refer to as scale-invariance (or scale- freedom) in this paper. Indeed, it guarantees 
that, for any value of N, the associated joint probabilities {~KN,n} produce marginal probabilities which coincide with 
{iTN-i,n} ■ Assuming ttiq + 7Tn = 1, and taking into acount that the N-th row has one more element than the 
(N — l)-th row, a particular model is characterised by giving one element for each row. We shall adopt the convention 
of specifying the set {7Tjv,o G [0, 1], VA^} . Everything follows from it. There are many sets {ttjv.o} that satisfy Eq. 
(3). Let us illustrate with a few simple examples: 

(i) ttjv.o = jyxj (0 < 7r 10 < 1/2; N = 1,2,3,...). We have that all 2" states have nonzero probability if 
< 7Tio < 1/2 . The particular case ttiq = 1/2 recovers the original Leibnitz triangle itself 0: see Table II. 

(ii) 7Tjy,o — ( 7T io) N (a > 0; N — 1,2,3...). The a = 1 instance corresponds to independent systems, i.e., 
7rjv,n = (7i"io) JV ~"(l — ^io)" . If < 7Tio < 1, then all 2 N states have nonzero probability. The a = instance 
corresponds to ttn,o — nio, njsr t n = (n = 1,2, .., N — 1) and itn,n = 1 — ttio . If < ttiq < 1, then only two among 
the 2 N states have nonzero probability, VW, namely the states associated with 7T/v,o aud itn.n- 



(N = 0) (1,1) 

(AT = 1) (1,1/2) (1,1/2) 

(AT = 2) (1,1/3) (2,1/6) (1,1/3) 

(AT = 3) (1,1/4) (3,1/12) (3,1/12) (1,1/4) 

(AT = 4) (1,1/5) (4,1/20) (6,1/30) (4,1/20) (1,1/5) 



TABLE II: The left numbers within the parentheses correspond to Pascal triangle. The right numbers correspond to the 
Leibnitz harmonic triangle (d — N). 



We may relax the Leibnitz rule to some extent by considering those cases where the rule is satisfied only asymp- 
totically, i.e., 

lan — i ! = 1 („ = 0,1,2,...). (4) 

Such cases will be said to be not strictly but asymptotically scale-invariant (or asymptotically scale-free). This is, for 
a variety of reasons, the situation in which we are primarily interested. The main reason is that what vast classes of 
natural and artificial systems typically exhibit is not precisely power-laws, but behaviors which only asymptotically 
become power-laws (once we have corrected, of course, for any finite size effects). This is consistent with the fact that 
within nonextensive statistical mechanics S q is optimized by g-exponential functions (see 0, references therein, and 
Q), which only asymptotically yield power-laws. It is consistent also with a new central limit theorem that has been 
recently conjectured |9lll0l] for specially correlated random variables. 
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q — describable 




FIG. 1: Scheme representing the systems that are g-describable, globally correlated, asymptotically scale-free (ASF) and 
strictly scale-free (SSF). The q = 1 region corresponds to "locally" correlated systems. Leibnitz rule is strictly satisfied for 
SSF, but only asymptotically satisfied for ASF. Below (above) the continuous red line we have the ASF (non ASF) systems. 
The SSF systems (below the dashed red line) constitute a subset of the ASF subset. The red spots correspond to the four 
families of discrete systems illustrated in the present paper: (a) q ^ 1 non ASF (upper spot; Eqs. (12) and (14)); (b) q 7^ 1 
ASF but non SSF (middle spot; Eqs. (17) and (24)); (c) q ^ 1 SSF (right bottom spot; Eq. (8)); (d) q = 1 SSF (left bottom 
spot; examples (i) and (ii) in the text). 

Let us now introduce a further concept, namely q-describability. A model constituted by N equal and distinguishable 
subsystems will be called q- describable if a value of q exists such as S q (N) is extensive, i.e., linijv^oo Sg ^ f ^ < 00. If 
that special value of q equals unity, this corresponds to the usual BG universality class. If that value of q differs 
from unity, we will have nontrivial universality classes. If the subsystems {A{\ are not necessarily equal, the system 
is g-describable if an cntropic index q exists such that limjv^oo ^^l 1 ^ ',"J~f N ' > < 00. It should be clear that we 

could equally well demand the extensivity of say S2— q (or even of Sq( q ) , where Q(q) is some monotonically decreasing 
function of q satisfying Q(l) = 1) instead of that of S q . This would of course have the effect of having nontrivial 
solutions for q > 1 whenever we had solutions for q < 1 if the extensivity that was imposed was that of S q . 

Finally, let us point out that we might consider the subsystems of a probabilistic system to be either strongly (or 
globally) correlated or weakly (or "locally") correlated. The trivial case of independence, i.e., when the subsystems are 
uncorrelated, is of course a particular case of weakly correlated. Let us make these notions more precise. A system 
is weakly correlated if for every generic (different from zero and from unity) joint probability r ^t 1 1 t, A2 \ N +AN a se ^ 

^A 1 +A 2 + ...+A N 

of individual probablities {7r * } exists such that limjv^oo ' 1 ^. 2 J v"'' a a = 1- Otherwise, the system is said strongly 

correlated. The particular case of independence corresponds to irfj = i 2 i T _ 1 i r x i N ^t^^ 2 iN " +An ( r — 
1, 2, N). If the subsystems are equal and binary, this definition becomes as follows: a system is weakly correlated 
if, for generic itn n, a probability po exists such that lirn/v^oc jv — — = 1. Otherwise the system is said to 

Pq (1-Po)" 

be strongly correlated. The particular case of independence corresponds to po = ttiq. In the present sense, weakly 
correlated systems could also be thought and referred to as asymptotically uncorrelated. The interplay of scale- 
invariance, g-describability and global correlation is schematized in Fig. 1. 

We have verified that all systems illustrated in (i) and (ii) above belong to the q = 1 class (see examples in Fig. 2). 
We next address q ^ 1 systems. 

A strictly scale-invariant discrete model 

In dealing with our first q ^ 1 discrete example, we start with two equal and distinguishable binary subsystems 
A and B (TV = 2). The associated joint probabilities are, with all generality, indicated in Table III, where k is the 
correlation between A and B. Let us now impose 0] additivity of S g 0|. In other words, we choose n(p) such that 
S q (2) = 25,(1), where (for W = 2) S q (l) = 1 " pg q "_ ( 1 1 " p)g , and (for W = 4) S q (2) = i-{P 2 +^^[ p{ i- P )-^-[ { i- P f+^ _ 
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FIG. 2: S q (N) for (a) the Leibnitz triangle [the explicit expression 7rjv, n = (jv+i) 7n ~ nas been used to calculate S g (iV)], 

(b) q = 1 (i.e., independent subsystems) with 7Tio = 1/2 [the explicit expression -KN,n = (7Tlo) _n (l — 7rio) n has been used to 
calculate S q (N)], and (c) a = 1/2 with 7Tio = 1/2 [the recursive relation (3) has been used to calculated S q (N)]. Only for q — 1 
we have a finite value for limjv^oo S q (N)/N; it vanishes (diverges) for q > 1 (g < 1). 
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TABLE III: Left: Joint and marginal probabilities for two binary subsystems A and B. Correlation re and probability p are 
such that < p 2 + re, p (1 — p) — re, (1 — p) 2 + re < 1 (re = corresponds to independence, for which case entropy additivity 
implies q = 1). Right: One of the two (equivalent) solutions for the particular case for which entropy additivity implies q = 0. 



We focus on the solutions K q [p) for < q < 1 indicated in Fig. [3] 17] . 
With the convenient notation 
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7"20 4- r n 


= no = 


: P, 



(5) 

we can verify 

no 4-: 

ni 4-r 02 = r i = 1 - p. (6) 

Let us now address the case of three equal and distinguishable binary subsystems A, B and C (N = 3). We present 
in Table IV probabilities that are not the most general ones, but rather general ones for which we have strict scale 
invariance, in the sense that all the associated marginal probability sets exactly reproduce the above N = 2 case. 
Notice how strongly this construction reminds us of the one that occurs in the renormalization group procedures 
widely used in quantum field theory, the study of critical phenomena, and elsewhere |l8j |. 

With the convenient notation 7r 30 ee r 30 = Pm B+C ; tt 3 i ee r 2 i = Pii 2 B+C = pf 2 "l B+C = P2ii S+C ; ^32 = r 12 = 
P22 + i B+C = P2i2 B+C = Pi2 + 2 B+C -, ^33 = r 03 = p^ +C ', and so on, we can verify 



no 4- 3r 2 i 4- 3r i2 4- r 03 = 1 , 
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FIG. 3: Curves n(p) which, for typical values of g, imply additivity of S q . For —1/4 < n < we have \J — k < p < 1 — \/—k 
For < K < 1/4 we have (1 - y/l - 4k)/2 < p < (1 + s/l - 4k)/2 . 



A 


1 


2 


1 


P 3 


+ K 9 (p)(2 + p) 


p 2 (l-p)- Kq (p)(l+p) 






p) - K,(p)(l + p)] 


[p(l -P) 2 + K q (p)p] 


2 


p 2 (i- 


P) - «9(P)(1+P) 


P(l -P) 2 + ««(P)P 




[p(i 


-p) 2 + Mp)p] 


[(l-p) 3 + K9 (p)(l-p)] 



TABLE IV: Scale-invariant joint probabilities p i:j l B+ (i,j,k — 1,2): the quantities without (within) square-brackets [ 
correspond to state 1 (state 2) of subsystem C. 

r30 + r 2 i = r 20 = p 2 + K q (p) , 
r2i+n2 = =p(l -p) - Kq{p) , 

ri2 + ro3 = r 2 = (1 - p) 2 + K g (p) , (7) 

and so on. 

(JV = 0) (1,1) 

(N = l) (l,no) (l,n,i) 

(AT = 2) (l,rao) (2,m) (l,r 02 ) 

(iV = 3) (l,r 30 ) (3,r 2 i) (3,n 2 ) (l,r 03 ) 

(AT = 4) (l,r 40 ) (4,r 3 i) (6,r 22 ) (4,ri 3 ) (l,r 04 ) 
TABLE V: Merging of Pascal triangle with the present Leibnitz-like probability set. The particular case rio = roi = 1/2; r 2 o = 
ro2 = 1/3; rn = 1/6; r 30 = r 03 = 1/4; r 3 i = n 3 = 1/12; r i0 = r 4 = 1/5; r 3 i = n 3 = 1/20; r 22 = 1/30, recovers the 
Leibnitz triangle 0- 

Let us complete this example by considering the generic case (arbitrary N). The results are presented in Table 
V, where we have merged the Pascal triangle and the present Leibnitz-like triangle 7J. For the left elements, we 
have the usual Pascal rule, i.e., every element of the iV-th line equals the sum of its "north-west" plus its "north- 
east" elements. For the right elements we have the property that every element of the ^V-th line equals the sum of 
its "south-west" plus its "south-east" elements. In other words, for (N = 1,2,3,...; n = 0, 1,2, ...,N), we have that 
TN-n,n + nv-n-i,n+l = rAr_„_i !n , and also that J2 n =o (N~ny.n\ r N-n,n = 1 (N = 0,1, 2, ...). These two equations 
admit the following solution 
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[N(l-p) + (p N -1)] 
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TN-IA = P 1 (l~p) ~ K q (p) — 



(8) 



^N — r 



„N-7 
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(i-pY 



i 



,(p) 



(2 < n < JV) . 



Summarizing, as long as rjy,o > 0, this interesting structure takes automatically into account (i) the standard 
constraints of the theory of probabilities (nonnegativity and normalization of probabilities), and (ii) the scale- invariant 
structure which guarantees that all the possible sets of marginal probabilities derived from the joint probabilities of 
N subsystems reproduce the corresponding sets of joint probabilities of N — 1 subsystems. Consistently S q is strictly 
additive for all N < N rnax , where N max depends on (p,q) |l7| . In this way, the correlation K q (p) that we introduced 
between two subsystems will itself be preserved for all N < N max . 

Let us now address the following question: how deformed, and in what manner, is the occupation of the phase 
space ( A-dimensional "hypercube" , in the same sense that the N = 2 phase space may be seen as a "square" , and the 
N = 3 one as a "cube") in the presence of the scale- invariant correlation K q (p) determined once and for all? (See Fig. 
3) The most natural comparison is with the case of independence (which corresponds to k = 0, hence to q = 1). It is 
then convenient to define the relative discrepancy r)N-n,n = {rN-n,n/[p N ~ n (l — p) n ]} — 1 (naturally, other definitions 
for discrepancy can be used as well, but the present one is particularly simple). Since n = 0,1, 2, N, we may expect 
in principle to have N + 1 different discrepancies. It is not so! Quite remarkably there are only three different ones, 
namely ?7jv,0j Vn-i,i, and all the others, which therefore coincide with 770, jv- They are given by 



Vn,o 
VN-1,1 

VN -11,71 



{\-pY 

K q (p) 



1 



N(l-p) - 1 



< 0. 



«M ( 1 _J_\ >0 

{i-p) 2 \ p N - 1 J - ' 

Kq(p) 



(9) 



< (2 < n < N) , 



where the inequalities hold for < q < 1, for which K g (p) < 0. Of course, the equalities in (9) correspond to q = 1 
(i.e., k = 0). See Fig. 3. We see that, for arbitrary N > 2, only three different types of vertices emerge in the 
N— dimensional hypercube. These can be characterized by the (1, 1, 1) corner, the N sites along each cartesian 
axis emerging from this corner, and all the others. As N increases, the middle type predominates more and more, 
with increasingly uneven occupation of phase space. 

The present example corresponds to 7r/v,o = r/v,o as given in Eq. (8). It is important to notice in this case that, 
for fixed (p, q) such that p < 1 and q < 1, there is a maximal value of N, noted N max (p, q), for which the analytical 
expression for r^o in Eq. (8) is nonnegative. For N > N rnax , we are obliged to consider r^ .0 = 0, which, through 
application of the Leibnitz rule, leads to violations of the nonncgcitivity of all ?"_/v— n,n- 

When this happens, of course 

the additivity of the entropy, i.e., S q (N) — NS q (l), does not hold any more. Unless we have the trivial situation 
q = 1 (for which entropic additivity holds for all < p < 1), the thermodynamic limit N — > 00 imposes p = 1 for 
< q < 1. Indeed N max (l,q) — > 00 Vg £ [0,1]. For all other values of p < 1 and q < 1, N max (p,q) is finite. 



A discrete model that is not asymptotically scale-invariant 

Let us consider the probabilistic structure indicated in Table VI, where, for given N, only the d + 1 first elements 
are different from zero, with d = 0,l,2,...,iV. 

As we see, 7rjy = for JV > d + 1 and n = d + 1, d + 2, JV. The total number of states is given by W(N) = 2 N 
(yd) , but the number of states with nonzero probability is given by 

n=0 y ' 
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FIG. 4: r)N,o{p) {left), ijn-i,i(p) (center), and r]N-n,n(p) (right), for q — 0.75, and N < 5. We see that, when N increases, only 
the N axes touching the (1, 1, 1) corner of the hypercube remain occupied with an appreciable probability. Notice however 
that, for given (p, q), N is allowed to increase only up to a maximal value N ma x(p, q) (only N m ax(l, q) and N ma x(p, 1) diverge). 



(N = 0) (1,1) (1,1) 

(N=l) {1,4$) (Mff) V-MV) (Mi?) 

(N = 2) (1,4$) (2,4?) (1,0) (1,4?) (2,4?) (1,4?) 



(N = 3) (1,4?) (3,4?) (3,0) (1,0) (1,4?) (3,4?) (3,4?) (1,0) 

(N = 4) (l ;7 r«) (4,^) (6,0) (4,0) (1,0) (!,*<?) (4,tt<?) (6,7$) (4,0) (1,0) 



TABLE VI: Probabilistic models with d = 1 (Ze/t) and d = 2 (rip/rf). 



where e# stands for effective. For example, W^(7V,0) = 1, VF eff (iV, 1) = N + 1, W ejr (7V,2) = §jV(JV + 1) + 1, 
W eJf (7V, 3) = ±N(N 2 + 5) + 1, and so on. For fixed d and TV -> oo we have that 

^(7V,d)~— (11) 



Let us now make a simple choice for the nonzero probabilities, namely equal probalities. In other words, 

r (<0 

N,n 



4*1 = 1/2 N (if N<d), 



«Z = TFT^T) (ifTV>rfandn< d) , (12) 
^nL = {if N > d and n> d) . 
See Table VII for an illustration of this model. 

(N = 0) (1,1) (1,1) 

(N=l) (1,1/2) (1,1/2) (1,1/2) (1,1/2) 

(N = 2) (1,1/3) (2,1/3) (1,0) (1,1/4) (2,1/4) (1,1/4) 

(N = 3) (1,1/4) (3,1/4) (3,0) (1,0) (1,1/7) (3,1/7) (3,1/7) (1,0) 

(N = 4) (1,1/5) (4,1/5) (6,0) (4,0) (1,0) (1,1/11) (4,1/11) (6,1/11) (4,0) (1,0) 

TABLE VII: Uniform distribution model with d = 1 (left) and d = 2 (rip/it). 



The entropy for this model is given by 



_ [W eg ( N,d)Y-i - 1 jyd(i-g) 

(l-g)(d!)i-« ' 



where we have used now Eq. (11). Consequently, S q is extensive (i.e., S q (N) cx TV for N — > oo) if and only if 

*=l-±. (14) 
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Hence, if d — 1,2,3..., the entropic index monotonically approaches the BG limit from below. We can immediately 
verify in Table VII (and using Eq. (12)) that this model violates the Leibnitz rule for all N, including asymptotically 
when N — > oo. Consequently, it is neither strictly nor asymptotically scale-free. However, it is g-describable (see Fig. 
I). 



An asymptotically scale-invariant discrete model 

Starting with the Leibnitz harmonic triangle, we shall construct a heterogeneous distribution 7rj^ n . The Leibnitz 
triangle is given in Table II and satisfies 

PN,n = PN+l,n + PN+l,n+l, (15) 

1 (N-n)\n\ 

PN ' n = (FTT) m ■ (16) 



We now define 



(d) _ j PN.n + 1 { n]u S N ] ( n < d ) n 7) 

^•"-jo (n>d) (7) 



where the excess probability sffl and the distribution ration lffi n (with < e < 1) arc defined through 

N 

n \t i. = 

N + l 



,(<*) = 
b N — 



x - N — d 

k=d+l 



{1-e (n = 0) 

(l-^-lS^^ 1 (0<n<rf) (19) 
t d l ( Z (n = d) 

with 

* s n w d) _ w n- 1) = n Etn [m/{N _ n)! n!] (»>°). ( 2 °) 

where W eff (./V, c() is given by Eq. (10). 

(iV = 0) (1,1) (1,1) 

(N=l) (1,1/2) (1,1/2) (1,1/2) (1,1/2) 

(JV = 2) (1,1/2) (2,1/4) (1,0) (1,1/3) (2,1/6) (1,1/3) 

(N = 3) (1,1/2) (3,1/6) (3,0) (1,0) (1,3/8) (3,25/288) (3,25/288) (1,0) 

(N = 4) (1,1/2) (4,1/8) (6,0) (4,0) (1,0) (1,2/5) (4,21/400) (6,43/1200) (4,0) (1,0) 

TABLE VIII: Leibnitz-triangle-based e = 0.5 probability sets: d = 1 {left), and d = 2 {right). 
We have verified for = 1,2,3,4 and iV^ooa result that we expect to be correct for all d < N/2, namely that 

< 7T W ,n+l << lTN,n ~ 7TjV-l,n << L hence 

7T (d) 

lim iV - 1 ;" = 1 , (21) 

w Af,n T "iV,n+l 

lim JgfM. = ! . (22) 

In other words, the Leibnitz rule is asymptotically satisfied for the entire probability set {ttn,u}, i.e., this system has 
asymptotic scale invariance. Its entropy is given by 

W,« - (23) 
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FIG. 5: Illustrations of the extensiviy of S q for the q / 1 ASF model (with e = 0.5): (a) d = 1; (b) d = 2; (c) d — 3. Notice 
that the minimal value of N equals d — 1. Insets: Included to improve the perception of the fact that limjv^oo Sq j^'' > vanishes 
(diverges) if q > (g < ^tj), whereas it is finite for g = j^j- 



and we verify that a value of g exists such that limjv-,00 Sq ^' d ' is finite. Our numerical results suggest that, for 
< e < 1, (see Fig. 5) 

d-l 

9=T7T- ( 24 ) 



III - CONTINUOUS MODEL 



Let us now address our last example, namely a continuous model. It is known that classical mechanics violates the 
3rd principle of thermodynamics, whereas quantum mechanics conforms to it. Indeed, in the latter we typically have 
lim-j^o limjv^oo S(N,T)/N = (T being the absolute temperature), whereas in the former such a limit is typically 
negative, and can even diverge to — oo. Consistently, the present continuous model is going to have, as we shall see, 
difficulties of the same type. This, however, does not affect its scaling properties with N, which constitutes the central 
scope of the present paper. We shall therefore dedicate some effort to explore such continuous cases. We consider the 
following probability distribution: 

P(*)= r( * e- x2 (l + ax 2 ) (o>0) (25) 

We can verify that dxp(x) = 1 . This distribution is illustrated in Fig. 6. 
The entropy corresponding to one subsystem (i.e., N = 1) is given by 



with US 



S q (l) 



l - 



f* J oo dxe-i( x2 +y^(l + ax 2 )i 



V^F(2+a)_ 

9-1 " 



I(a,q) 



(26) 



/OO 
dze~ z \l + -z 2 ) q 
OO Q 
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FIG. 6: Distribution p(x) for typical values of a. The point shared by all distributions is located at = (l/\/2 , l/\feit) ~ 

(0.707,0.342). 




FIG. 7: Dependence of S g (l) on a for typical values of q. S q is positive for a < a c (q) and negative for a > a c (q). The threshold 
value a c decreases from infinity to zero when q increases from zero to unity. For q = 1 we have that Sbg < for all a > 0, thus 
exhibiting the well known difficulty of classical statistics. 



r and i-Fi being respectively the Riemann's T and the hypergeometric functions. The a-dependence of S q for typical 
values of q is depicted in Fig. (7). As expected for continuous distributions, negative values for S q do emerge. 
Let us now compose two such subsystems. If they are independent (q = 1) we have 



Pi(x,y) =p(x)p{y) = 



[1 + a{x 2 + y 2 ) + a 2 x 2 y 2 } 



(28) 



7r(2 + a) 2 

Of course, dxdy Pi(x, y) = 1. For the general case, we propose the following simple generalization oip(x)p(y): 

4 



P q (x,y) 



ir(4 + 4A + B) 



-^+y">[l + A(x 2 +y 2 )+Bx 2 y 2 }, 



(29) 



which satisfies J™ dxdy P q (x, y) = 1. Of course, for q = 1, we expect (A, B) — (a, a 2 ). Let us now calculate the 
marginal probability, i.e., 



f°° , 2(2 + ^)e- 

/ dyP q (x,y) 

J — OO 



0F(4 + 4^ + B) 



2A + B 



(30) 
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FIG. 8: (a, g)-dependence of A (A = a for g = 1). Left: For typical values of q. Right: For typical values of a. 

We want this marginal probability to recover the original p(x), so we impose (2A + B)/{2 + A) = a, which implies 
B = a A + 2 (a — A) and dyP q (x, y) — p(x). It follows that 



e -^+y 2 ){l + A(x 2 + y 2 ) + [aA + 2(a - A)]x 2 y 2 } . 



7r[4 + 2(a + A) + aA] 
Finally, to have A as a function of (q,a), we impose, as for the binary case, 

S,(2)=2S,(1), 

where S q (l) is given by Eq. j^Sjl and 

i-rj-«^[^>»)]' 



9-1 

4 



7r[4+2(a+A)+a J 4] 



J-^oo JZo dxd V e~^ + y^{l + A{x 2 + y 2 ) + [aA + 2(a - A)^ 2 ?/ 2 } 9 



9-1 



7r[4+2(a+A)+aA] 



J(a,A,q) 



9-1 



with Li 



J(a,A9) 



OO pOC 



dudve- ( - u2+v2 1 



— oo •/ — OO 



• , o a^4 + 2(a — A) 2 2 
1 + — {u 2 + v 2 ) H 1 ^-uV 



.4 
9 



1 + (A/q)z 2 



e- z2 (l + (A/q)z 2 y 



r(-9) 7-oo V ^ + t( aA + 2 ( a - A ))l^ z '' 

_ / 1 \ /l 3 1 + (A/q)z 2 

^ V2 ~ V 11 V2' 2 + 9 ' (A/< Z ) + [(aA + 2(a-A))/g 2 ]z 2 
(A/ g ) + [(aA + 2( a -A))/ g 2 ]z 2 ^+ g /l 

l + (A/g)z 2 J [ q> \2 q 



1 + (A/q)z 2 



q, 2 q ' (A/q) + [(aA + 2(a- A))/q 2 ]z 2 



See in Fig. 8 the a-dependence of A for typical values of q. Finally, the relative discrepancy 

, \ _ P q (x,y) 1 



(31) 



(32) 



(33) 



(34) 



(35) 
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FIG. 9: rj(x,y;a,q) for (o, q) = (0.5,0.95) (hence A — 2.12); x = y is a plane of symmetry, i.e., rj(x,y;a,q) = r/(y,x;a,q). The 
two bold straight lines correspond to ij = 0. 



is illustrated in Fig. 9 for a typical set (a, q). For higher values of TV we follow here a procedure similar to the one in 
our discrete example SSF of Fig. 1. Let us address the N = 3 case. For the case of independence, we have 

Pi (x, y, z) = P (x)p(y)p(z) oc e -(* 2 +y 2 +z 2 ) [! + a ( x 2 +y 2 + z 2 ) + a 2 (x 2 y 2 + y 2 z 2 + z 2 x 2 ) + a 3 x 2 y 2 z 2 }. (36) 

We consistently assume 

P q (x,y,z) = ^ 3/2(8 + 12 ^ + 6g3 + C3) e- ( ^ 2+2 ^^ (37) 

which satisfies dx dy dz P q (x , y , z) = 1. Clearly, for q = 1, (A 3 ,_B 3 ,C3) = (a, a 2 , a 3 ). For the general 

case, we impose that dzP q (x, y, z) = P q (x, y), i.e., the N = 2 distribution as given by Eq. (31). This imposition 
implies 



2A 3 + B 3 

2 + A 3 
2B 3 + C 3 



= A 



i 



2 + ^3 

2 + A 3 1 



B 2 = B , (38) 



8 + 12^3 + 6B 3 + C 3 4 + 4A 2 + B 2 

hence 

4A 2 - 2B 2 + C 3 



A 



3 



4 - 2yl 2 + B 2 



AB 2 + {A 2 -2)C 3 

B " A-2A 2 + B 2 ■ (39) 

The coefficient C 3 > must satisfy that C 3 = a 3 for q = 1. If S q (3) = 3S q (l) is automatically satisfied, we have some 
freedom for choosing C 3 . Natural choices could be C 3 = a 3 and C 3 = A3B3 (which automatically satisfies C 3 = a 3 
for q = 1). If, however, S q (3) 7^ 3S q (l), we can impose the equality and determine a better approximation for q. 
The new value is expected to be only slightly different from the one that we already determined by imposing entropic 
additivity for N ~ 2. The procedure can in principle be iteratively repeated for increasing N. Although such a study 
has its own interest, it lies outside the scope of this article. 
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IV - FINAL REMARKS 

Let us now critically re-examine the physical entropy, a concept which is intended to measure the nature and amount 
of our ignorance of the state of the system. As we shall see, extensivity may act as a guiding principle. Let us start 
with the simple case of an isolated classical system with strongly chaotic nonlinear dynamics, i.e., at least one positive 
Lyapunov exponent. For almost all possible initial conditions, the system quickly visits the various admissible parts 
of a coarse-grained phase space in a virtually homogeneous manner. Then, when the system achieves thermodynamic 
equilibrium, our knowledge is as meager as possible (microcanonical ensemble) , i.e., just the Lebesgue measure W of 
the appropriate (hyper) volume in phase space (continuous degrees of freedom), or the number W of possible states 
(discrete degrees of freedom). The entropy is given by Sbg(N) = klnW(N) (Boltzmann principle |2fJ,|2lJ). If we 
consider independent equal subsystems, we have W(N) = [W(l)] , hence Sbg(N) = NSbg(^)- If the N subsystems 
are only locally correlated, we expect W(N) ~ [i N (ji > 1), hence \iu\n^ooSbg(N)/N = fi, i.e., the entropy is 
extensive (i.e., asymptotically additive) 

Consider now a strongly chaotic case for which we have more information, e.g., the set of probabilities {pi} (i — 
1, 2, W) of the states of the system. The form S B g = ~kY,Y =l Pi hip* yields S B g(A + B) = S B g(A) + S B g(B) 
in the case of independence (pfj +B — pfpf)- This form, although more general than klnW (corresponding to equal 
probabilities), still satisfies additivity. It frequently happens, though, that we do not know the entire set {pi}, but 
only some constraints on this set, besides the trivial one "Y^tLiPi — 1- The typical case is Gibbs' canonical ensemble 
(Hamiltonian system in longstanding contact with a thermal bath), in which case we know the mean value of the 
energy (internal energy). Extremization of Sbg yields, as well known, the celebrated BG weight, i.e., pi cx e~^ Ei , 
with (3 = 1/kT and {Ei} being the set of possible energies. This distribution recovers the microcanonical case (equal 
probabilities) for T — > oo. 

Let us now address more subtle physical systems (still within the class associated with strong chaos) , namely those 
in which the particles are indistinguishable (bosons, fermions). This new constraint leads to a substantial modifica- 
tion of the description of the states of the system, and the entropy form has to be consistently modified, as shown 
in any textbook. These expressions may be seen as further generalizations of Sbg, an d the extremizing probabilities 
constitute, at the level of the one-particle states, generalizations of the just mentioned BG weight, recovered asymp- 
totically at high temperatures. It is remarkable that, through these successive generalizations (and even more, since 
correlations due to local interactions might exist in addition to those connected with quantum statistics), the entropy 
remains extensive. Another subtle case is that of thermodynamic critical points, where correlations at all scales exist. 
There we can still refer to Sbg, but it exhibits singular behavior |2^ . 

Finally, we address the completely different class of systems for which the condition of independence is severely 
violated (typically because the system is only weakly chaotic, i.e., its sensitivity to the initial conditions grows slowly 
with time, say as a power-law, with the maximal Lyapunov exponent vanishing). In such systems, long range cor- 
relations typically exist that unavoidably point toward generalizing the entropic functional, essentially because the 
effective number of visited states grows with iV as something like a power law instead of exponentially. We exhibited 
here such examples for which (either exact or asymptotic) scale-invariant correlations are present. There the entropy 
S q for a special value of q ^ 1 is extensive, whereas Sbg is not. 

Weak departures from independence make Sbg lose strict additivity, but not extensivity. Something quite analogous 
is expected to occur for scale-invariance in the case of S q for q ^ 1. Amusingly enough, we have shown (see also 
ISL Il5| ) that the "nonextensive" entropy S q — indeed nonextensive for independent subsystems — acquires extensivity 
in the presence of suitable asymptotically scale-invariant correlations. Thus arguments presented in the literature that 
involve S q (with q ^ 1) concomitantly with the assumption of independence should be revisited. In contrast, those 
arguments based on extremizing S q , without reference to the composition of probabilities, remain unaffected. While 
reference to "nonextensive statistical mechanics" still makes sense, say for long-range interactions, we see that the 
usual generic labeling of the entropy S q for q ^ 1 as "nonextensive entropy" can be misleading. 

The asymptotic scale invariance on which we focus appears to be connected with the asymptotically scale-free 
occupation of phase space that has been conjectured 0] to be dynamically generated by the complex systems addressed 
by nonextensive statistical mechanics (see also Extensivity — together with concavity, Lesche- stability 25], and 

finiteness of the entropy production per unit time — increases the suitability of the entropy S q for linking, with no 
major changes, statistical mechanics to thermodynamics. 

Last but not least, the probability structure of our discrete cases is, interestingly enough, intimately related to both 
the Pascal and the Leibnitz triangles. 
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